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Abstract — Let C be a linear code with lengtli n and minimum 
distance d. The stopping redundancy of C is defined as the 
minimum number of rows in a parity-check matrix for C such 
that the smallest stopping sets in the corresponding Tanner 
graph have size d. We derive new upper bounds on the stopping 
redundancy of linear codes in general, and of maximum distance 
separable (MDS) codes specifically, and show how they improve 
upon previously known results. For MDS codes, the new bounds 
are found by upper bounding the stopping redundancy by a 
combinatorial quantity closely related to Tiiran numbers. (The 
Turdn number, T{v, k, t), is the smallest number of t-subsets of 
a w-set, such that every fc-subset of the u-set contains at least one 
of the t-subsets.) We further show that the stopping redundancy 
of MDS codes is T[n,d - l,d - 2)(1 + 0(n-^)) for fixed d, 
and is at most T{n,d — l,d — 2)(3 + 0(n~^)) for fixed code 
dimension k — n — d+1. For d = 3, 4, we prove that the stopping 
redundancy of MDS codes is equal to T{n, d — 1, d — 2), for which 
exact formulas are known. For d = 5, we show that the stopping 
redundancy of MDS codes is either T{n, 4, 3) or T{n, 4, 3) + 1. 

Index Terms — stopping sets, stopping distance, linear codes, 
MDS codes, Tiiran numbers, Golay codes. 



I. Introduction 

Stopping sets play an important role in the performance of 
iterative decoding of linear codes on erasure channels. Unlike 
the weight distribution, which is a property of the code itself, 
stopping sets are dependent on the actual Tanner graph (or 
parity-check matrix) used to describe the code. In terms of the 
Tanner graph, a stopping set is a set of variable nodes such 
that no check node is connected to the set with a single edge. 
Equivalently, in terms of a parity-check matrix H, a stopping 
set is a set of column indices such that the submatrix formed 
by the corresponding columns of H does not contain a row 
of weight one. We will focus on the interpretation in terms of 
the parity-check matrix. It should be noted that in our context 
a parity-check matrix can have dependent rows as long as the 
rows of the matrix span the dual code. 

For a chosen H, define the size of the smallest non-empty 
stopping set as its stopping distance, denoted by s{H). s{H) 
is an important parameter for iterative decoding on erasure 
channels, and should be maximized for better performance. 
Let C be a linear code and denote its minimum distance by 
d{C). Since the support of any codeword is a stopping set, 
s{H) < d{C) for all choices of H. We are interested in how 
many parity checks are needed such that s{H) = d{C) can be 
achieved. The stopping redundancy of the code, denoted by 
p{C), represents the minimum number of rows in a parity- 
check matrix such that s{H) = d{C). This quantity was 
defined and first investigated by Schwartz and Vardy [1], 
[2]. They showed that p{C) is well-defined in that by proper 
choice of H, s{H) = d{C) can always be achieved. They then 
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developed general upper and lower bounds on p{C), as well 
as more specific bounds for Reed-Muller codes, Golay codes, 
and maximum distance separable (MDS) codes. The stopping 
redundancy of Reed-Muller codes has been further studied by 
Etzion [3]. 

In this paper, we propose new upper bounds on p(C) and 
compare them to those in [ 1 ] . For the general upper bound, we 
take a probabilistic approach [4]. In the case of MDS codes, 
Schwartz and Vardy pointed out a a link between p{C) and 
covering numbers. This led to a number of lower bounds on 
p{C). We show that p{C) of MDS codes is upper bounded 
by another combinatorial quantity. Further results reveal a 
strong connection between p(C) of MDS codes and Turan 
numbers - combinatorial quantities closely related to covering 
numbers. Specifically, the Turdn number, T{v, k, t), is the 
smallest number of t-subsets of a v-set, such that every k- 
subset of the v-set contains at least one of the i-subsets. 

In Section |ll| we derive general upper bounds on p{C). 
First, we consider binary linear codes. We show that an upper 
bound given in [1] has an interesting variant which is always 
tighter if d{C) is odd. We then propose another upper bound 
based on probabilistic analysis. We compare this bound to 
the other bounds and show that it is better in many interesting 
cases. In particular, for asymptotically "good" codes, the upper 
bound derived using the probabilistic method is always tighter. 
Next, we extend the upper bounds to linear codes over F^. We 
prove that, in this context as well, the upper bound based on 
probabilistic ideas is tighter for "good" codes. 

In Section |ni] we focus on MDS codes. First, we recall the 
observation made in [1] to show that for an MDS code C with 
length n and minimum distance d, p{C) > T{n, d — l,d — 2). 
Next, by introducing a new combinatorial object, we convert 
the quest for upper bounds on p{C) to a purely combinatorial 
problem. Proceeding in this way, we first discover that the 
lower bound of T{n,d — 1, d — 2) is tight for small values 
of d. In particular, for d = 3,4, we prove that p{C) — 
T{n, d—1, d—2), for which exact formulas are known, and, for 
d = 5, we show that p{C) is no greater than r(n, 4, 3) + 1. 
We then generalize these results and show that for a fixed 
minimum distance d, the stopping redundancy of MDS codes 
is asymptotically equal to T(n, d— 1, d—2). Finally, we obtain 
tighter upper bounds through explicit constructions of the 
newly defined combinatorial object. One of the upper bounds 
further shows that for fixed code dimension k = n — d + 1, 
the stopping redundancy of MDS codes is asymptotically at 
most T(n, d-l,d- 2)(3 + 0{n-^)). 

Section HVl concludes the paper. 
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II. General Bounds 

A. Binary linear codes 

Let r(C) denote the redundancy of code C, i.e. r(C) = 
dim(C-'"), where C-*" is the dual code of C. The following 
theorem is taken from [1]. 

Theorem 1 Let C be a binary linear code with d{C) > 3. 
Then 



p{c)< E 



r(C) 



(1) 



Following the same idea, we derive the following bound, 
which is often better than 0. 

Theorem 2 Let C be a binary linear code with d{C) > 2. 
Then 



riO 
2i - 1 



(2) 

□ 



Proof: Take any basis of to form a parity-check 
matrix H. If C is of length n, then iJ is an 7'(C) x n matrix. 
Now, for all odd i, 1 < i < d{C) — 1, take all non-zero linear 
combinations of i rows of H and put them all together to form 
a new matrix H' . Clearly, H' is a parity-check matrix for C, 
and the number of rows in H' is exactly the quantity on the 
right-hand-side of (|2ji. 

It suffices to show that s{H') = d{C). For t = 
1,2,.... d{C) — 1, take an arbitrary set of t columns of H 
and form the matrix Ht- Take the corresponding t columns of 
H' and form the corresponding matrix H[. Since t < d{C), 
the columns of Ht are linearly independent. Therefore, there 
exist t rows of Ht that form a basis for F|. Take t such rows 
of Ht and call this t x t matrix Htt- Clearly, Htt is full rank. 

By construction, H't contains all linear combinations of an 
odd number of rows of Htt- The proof is complete if we can 
show that at least one of these linear combinations yields a 
vector of weight one. Think of linearly combining rows of 
Htt as multiplying Htt by a row vector on the left. Then the 
linear combinations of rows of Htt that give vectors of weight 
one are precisely described by the rows of G, where G is a 
txt binary matrix such that GHtt = I- {I is the txt identity 
matrix.) That is, they are precisely described by the rows of 
H^^. The fact that Hf^^ is a full rank binary matrix implies 
that H^^ must have at least one row of odd weight. ■ 

Remark If d{C) is odd, then the bound of ^ is always better 
than Q as it sums a proper subset of the terms in Q, all 
of which are positive. If d{C) is even, an improvement is not 
guaranteed since the bound in ^ includes the term {^J^'^^i) 
while that in Q does not. For the particular case where r{C) 
grows with n while d{C) remain fixed, (|3 is asymptotically a 
looser bound. One can, of course, always take the smaller of 
the two to get best results. □ 

Remark Bound ^ implies that p{C) < 2^^^^~^, an upper 
bound which can not be deduced from Q. Note that p{C) < 
2''(C) _ I can be easily shown by considering a parity-check 
matrix that contains all nonzero codewords of C^. (See [l].)n 



We now propose another upper bound on p{C) based on a 
probabilistic approach (cf. [4]). 

Theorem 3 Let C be a binary linear code with length n. Then 

p{C)<p*{n,d{C))+r(C)-d{C) + l, (3) 
where p* (n, d) is the smallest integer p* that satisfies 



i=l 



1 r 

2' 



< 1 



(4) 



Proof: For any given number of rows, p, consider a 
random ensemble of matrices. Hp, consisting of all p x n 
matrices whose rows are codewords of C^. Let the probability 
measure P on Hp be that which is induced when the rows of 
matrices in Hp are chosen uniformly and independently from 

Let [nY denote the set of all i-element subsets of 
{1, 2, . . . , 7i}. Using the terminology of [1], we refer to the 
elements of [nY as i-sets and think of them as sets of vector 
coordinates. For a matrix H with n columns, we say that H 
covers t S [n]* if the projection of rows of H onto t contains 
a vector of weight one. Clearly, s{H) ~ d{C) if and only if 
H covers all i-sets for i — 1, . . . , d{C) — 1. 

It is well-known [5, p. 139] that the matrix of all codewords 
of is an orthogonal array of strength d{C) — 1. This implies 
that on any i-set, i = 1, . . . , d{C) — 1, all i-tuples appear, 
and they appear the same number of times. Since there are 
i weight-one vectors among a total of 2* possible i-tuples, 
the probability that any given i-set is covered by a randomly 
chosen codeword of C-^ is i/2\ Hence, for i — 1, . . . , d{C) — l, 
the probability that a given i-set is not covered by rows in a 
matrix in the random ensemble Hp is (1 — ijT'Y ■ We have 

P({all i-sets are covered, i = 1, . . . , d(C) — 1}) (5) 
= 1 — -P({at least one i-set is not covered 

for some i e {1, . . . , d{C) ~ 1}}) (6) 

/d(C)-l 

= 1 - P (J (J {i is not covered} | (7) 

\ i=l te[n]' 
d(C)-l , 

(i(C)-l 

1- V f'.Mfl-^) . (9) 



If Et?"'a)(l - f)" < 1' then 

P({all i-sets are covered, i = 1, . . . , d(C) — 1}) > 0, 
which implies that there exists H G Hp that covers all i-sets, 
i = 1, . . . , rf(C) - 1. Note that the fact that H covers all 
i-sets up to i = d(C) — 1 implies that rank(i?) > d[C) — 1. 
Therefore, by adding at most r(C) — d(C) + 1 appropriate 
codewords from as additional rows to H, we have 
found a parity-check matrix for C that covers all i-sets, 
i = 1,.. .,d(C) - 1. ■ 

The upper bound given in Theorem |3] involves solving an 
inequality. A closed form expression would be desirable. This 
is addressed in the following corollaries. 
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Corollary 4 Let C be a binary linear code with length n and 
minimum distance d{C) < n/2. Then 

p{C) < ""^'^^''^^"'^-^^-^' i^ + r{C) diO + 1, 



— iOg I i — „d(C)-i 



where S = and h{d) = (5 log i + (1 - 5) log 



(10) 



Proof: First note that (1 — z/2') is non-decreasing in i, 
SO that 



E 



d-i^'"-' 



r E 



^ rf(c) ^ 1 

n 

d(C)-l 



Next, for < ^ = < ^, it can be shown that 



E 

i=l 



n\ 5 I n 
i J 1 - 25 \6n 



(11) 



(12) 



Further, by Stirling's approximation it is known that ([6]) 



< 



1 



(13) 



ySnJ y/2TTnS{l ~ 8) 

Now, by putting together ( II 1> . (I12> . and (I13> . and referring to 
(0}, we see that a positive solution to the equation 

1-25 ^2^n5{\-b) K 2^(C)-i; ^'^^ 

must be an upper bound on p* {n, d{C)). We thus obtain 

- log (1 - ^khr ) 

Plugging dlSI l in (|3} we get the desired bound. ■ 
If we do not require d{C) < n/2, we have to weaken the 
upper bound, but the resulting bound has a simpler form. 

Corollary 5 Let C be a binary linear code with length n. Then 



P{C)< 



d(C)-l 



+ r(C)-d(C) + l. (16) 



- log (l - ^im^ J 

Proof: The argument is almost identical to the proof of 
Corollary |4] except that we instead bound Yl'i=i ^ Ci) 

d(C)-l 

I n \ 

< 2". (17) 



E 



Remark While the bounds in Theorem [2 and Theorem |2] are 
roughly on the same order, the upper bound in Theorem |3l 
often appears to be tighter than both. We demonstrate this for 
a specific example — the extended binary Golay code — and 
for two asymptotic scenarios (rf(C) and r{C) both linear in n, 
and d{C) fixed). 

Example 1 Let G24 denote the extended binary Golay 
(24, 12,8) code. In [1], it was shown by explicit construction 
that p{G24) ^ 35. This was later improved to p{G24) < 34 
[2]. 



Applying the upper bounds obtained in this section to Q2A, 
we see that Theorem ^ gives p{G2i) < 2509, Theorem |2| 
gives p{Q2i) < 1816, and Theorem |3] gives p{Q24) < 232. 
Also, the relaxed bounds in Corollary |3 and Corollary |5l give 
p{G2a) < 245 and p{Q2i) < 300, respectively. We see that 
in this example, bounds based on Theorem |3l have a clear 
advantage. □ 

Remark A 34-row parity-check matrix for Q24, that achieves 
maximum stopping distance is given in AppendixU Compared 
to the one reported in [2], this parity-check matrix is able to 
correct more low- weight erasure patterns. □ 

Example 2 The bound of Theoremlsjis a function of n, d{C) 
and r{C). Similarly, the bounds of TheoremQand Theorem|2| 
are functions of d{C) and r{C). In this example we consider 
the asymptotic behavior of these bounds as n 00. Detailed 
derivations can be found in Appendix HH 

We discuss two different assumptions about d{C) and r{C). 
The first case corresponds to "good" codes, i.e. codes whose 
rate is bounded away from zero and whose minimum distance 
is non-diminishing relative to the code length. The second case 
concerns codes with fixed minimum distance, an example of 
which is the family of extended binary Hamming codes. 
Case 1: d{C) = 5n, r{C) = 7?^, where 0<5<i0<7<l 
are constants. 

It can be shown that the bound in Theorem |3l is 9(2'^"). In 
comparison, the bounds of Theorem^and Theorem|2lare both 
17 Clearly, the bound given by Theorem |3l is tighter. 

Case 2: d{C) = d is a constant. 

With the expression in Corollary |3 it is not hard to see 
that the bound of Theorem |3l is 8(log n + r(C)). On the other 
hand, the bound given by Theorem^is clearly Q{r{CY~^); 
and the bound given by Theorem|2lis Q{r{CY-'^) if d is odd, 
and Q{r{CY-^) if d is even. 

By the Hamming bound, r(C) > logn for d > 3. Therefore, 
as long as rf > 3, the bound by Theorem |3] is asymptotically 
tighter. Since it is known for all binary linear codes [1] that if 
d{C) < 3, then p{C) ~ r{C), Theorem |3l gives a better bound 
asymptotically for all non-trivial values of d. □ 



B. Linear codes over ¥q 

The bounds in Theorem \l\ and Theorem |2l can both be 
viewed as improved versions of the more intuitive bound 
p{C) < C^P)' which extends in a straightforward 

manner to non-binary codes (although, unfortunately, the im- 
provements made in Theorem ^ and Theorem |2] cannot be 
carried over). 

Theorem 6 Let C be a linear code over F„. Then 



PiC)< 



rf(C)-l 

E 

i=l 



■(c) 



(18) 



Proof: The proof is similar to that of Theorem |2 Here 
we take a basis of and construct H by taking linear 
combinations of i basis vectors, for i = 1, . . . , d{C) — l. Instead 
of taking all linear combinations, note that for each i basis 
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vectors we may fix one of the linear coefficients at 1 and still 
be guaranteed that s{H) — d{C). ■ 
For C a linear code over F^, the codewords of are 
known to form an orthogonal array of strength d{C) — 1 with 
q levels ([7, ch. 4]). Therefore, the argument we used to prove 
Theorem |3] extends directly to non-binary codes. 

Theorem 7 Let C be a linear code over Fg with length n. 
Then 

piC) < p*in,d{C),q) + r{C) - d{C) + 1, (19) 
where p* (n, d, q) is the smallest integer p* that satisfies 



E(")(i-^V<i. 



(20) 

□ 



Corollary 8 Let C be a linear code over Fg with length n 
and minimum distance d{C) < n/2. Then 



log 1 



(q-l){d(C)-l) 



(21) 



where S = and h{5) = S log | + (1 — 5) log j^. □ 

Corollary 9 Let C be a linear code over ¥q with length n. 
Then 



P{C)< 



log(] 



(9-l)(d(C)-l) 



+ r{C)-d{C) + l. (22) 



Example 3 Let Q12 denote the ternary (12,6,6) Golay code. 
The bound of Theorem|6l gives p{Gi2) < 332, while the bound 
of Theorem0gives p{Gi2) < 160. The best known result (by 
construction, see [1]) is p{Gi2) < 22. □ 

Example 4 Similar to Example|2lfor the case of binary codes, 
we compare the bounds of Theorem |6l and Theorem as n 
00. Here we will only treat the case of "good" codes. 

Let d{C) = Sn, r{C) = 771, where < 6 < ^ and 
< 7 < 1 are constants. It is not hard to show that the bound 
of Theorem0is On the other hand, it can be shown 

(details provided in Appendix HH that the bound of Theorem|6l 
We see that the bound given by Theorem 



is D, -4=01-'^ 



is tighter 



III. MDS CODES 



Being MDS imposes a lot of structure on a code. We will 
take advantage of the special properties of MDS codes to show 
that their stopping redundancy is of a highly combinatorial 
nature and is closely related to Turan numbers. New, tighter 
upper bounds will be obtained through constructions. 

First a few notes (reminders) on notation. Let n, k be 
integers and A, B be sets. Then 

• |yl| :— Number of elements of A. 
. A\B := {x e A: X i B}. 

. [n] {l,2,...,n}. 

• [A]^ -.^ {X <Z A: \X\ = k} is the set of k-subsets of A. 



Also, a k-set is generally any set that has k elements. Particular 
to our discussions, a fc-set usually refers to a set of k codeword 
coordinates, i.e. a fc-subset of [a], if n is the length of the code. 

A Turan {v,k, t)-system is a set of t-subsets of a w-set, 
called blocks, such that each fc-subset of the w-set contains at 
least one of the blocks. The smallest number of blocks in a 
Turan (w, fc, i) -system is known as the Turan number, and is 
correspondingly denoted by T{v,k,t). For more information 
on Turan numbers, the reader is referred to [8], and references 
therein. 

Consider an MDS code C of length-n and minimum distance 
d. Then its dual code, C^, is an MDS code with minimum 
distance d-^ = n—d+2. Also, note that for all MDS codes with 
minimum distance d, any set of d coordinates is the support 
of at least one codeword. These properties (and many more) 
can be found in Mac Williams and Sloane [5]. 

The authors of [1] noted the following.' 

Theorem 10 Let C be a MDS code with length n and mini- 
mum distance d. Then 



p{C) > T{n,d- 2). 



(23) 



Proof: Suppose is a parity-check matrix for C and 
s{H) = d. Then each row of H has at most n — d^ = d — 2 
zeros. If /i is a row of H and t is a (d— l)-set, then h covers 
L if and only if h has {d — 2) zeros and the positions of the 
zeros in /i are a subset of t. Since all (d— l)-sets are covered 
by H, the complements of supports of minimum-weight rows 
of H form a Turan {n,d — l,d — 2)-system. ■ 
This link between stopping redundancy and Turan numbers 
immediately gives rise to a number of lower bounds on p{C) 
for MDS codes. For example, it is simple to note T{v,k,t) > 



(D/(rD = (")/(*)■ So we immediately obtain 



p{C) > T{n,d-l,d-2) > 



l\d-2 



(24) 



(cf. [1]). Better bounds can be obtained by utilizing a stronger 
lower bound on T{v, fc, t). 

Now, let C be an MDS code with length n and minimum 
distance d, and consider the minimum number of rows in a 
parity-check matrix for C all of whose rows are minimum- 
weight codewords of and that achieves the maximum 
stopping distance d. This number only depends on n and d, 
because 

1) as far as covering i-sets is concerned, only the supports 
of rows of the parity-check matrix matter; 

2) for any d-'--set as support, we can find at least one 
codeword in C-*^; 

3) all rows of a parity-check matrix that achieves p{C) must 
have distinct supports. 

'In [1], the observation was made with respect to covering numbers rather 
than Turan numbers. A {v,k,t) covering design is a set of fc-subsets of a 
D-set, such that each t-subset of the D-set is contained in at least one of the 
fc-subsets. The smallest size of a covering design is known as the covering 
number, and is correspondingly denoted by C(f, fe, t). It is simple to note that 
a {v, fc, t) covering design is a Turan (v,v — t,v — fc)-system and vice versa. 
Hence, C{v, fc, t) = T{v, v — t,v — k). For more information on covering 
designs and covering numbers, the reader is referred to [9]. 
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Let us denote this number by T'{n,d). Clearly, T'{n,d) is an 
upper bound of p{C). Note that r'(n, d) always exists since a 
matrix consisting of one codeword from for each (i-'--set 
as support achieves stopping distance equal to d (cf. [1]). 

We shall see that r'(n, d) is in fact a combinatorial quantity 
with a formulation similar to that of Turan numbers, without 
any explicit reference to codes at all. 

Definition 1 A single -exclusion (v, r)-system is a collection 
of r-subsets of a u-set, called blocks, such that for all i, i — 
1, . . . , r + 1, each i-subset of the w-set is covered by at least 
one of the blocks. Here, an i-subset l is covered by block (3 
if 

\i\P\ = l. (25) 

The smallest number of blocks in a single-exclusion (t;,r)- 
system is called the single-exclusion number, and is denoted 

hyV(v,r). □ 

Remark Clearly, condition M5\ is equivalent to 



|tn^| = 1. 



(26) 



Remark The definition of single-exclusion (u, r) -system re- 
quires that r < V — \. For r = w — 1, it is easy to see that 
r(i;,ti — 1) = w. For the sake of discussion, unless otherwise 
noted, we shall always make the assumption that r < v — 2. 
In relation to p(C), we are mostly interested in r(?T., d — 2), 
where n is the length of C and d is the minimum distance. 
Clearly, d — 2 < ?i — 2 is always satisfied. □ 

Remark A single-exclusion (t;, 7-)-system is always a Turan 
(D,r + l,r)-system. It is interesting that the definition of 
single-exclusion systems may actually be interpreted mean- 
ingfully in design theory terms. One can analogously define 
fc-exclusion (v, r)-systems. □ 

Let _ff be a parity-check matrix for C that achieves stopping 
distance d and whose rows all have weight d^. Then the 
positions of zeros in the rows of H form a single-exclusion 
(n, d — 2)-system. On the other hand, let S* be a single- 
exclusion [n, d — 2)-system. For each /3 e 5, we can find 
c € such that the support of c is [n] \ (3. If we use 
these codewords as rows to form matrix H, then s{H) = d. 
Note that s{H) = d impHes that H has a (d — 1) x (d — 1) 
upper triangular submatrix (up to column permutations) and 
hence rank(_ff) > d — \ = r{C^). Therefore, H is indeed a 
parity-check matrix. In summary, an Z-block single-exclusion 
[n, d — 2)-system exists if and only if an Z-row parity-check 
matrix consisting solely of minimum weight codewords of 
can be found that achieves maximum stopping distance. 
Relating to the earlier definition, it is clear that T'{n,d) = 

r(n,d- 2). 

The following comes straight from the discussions above. 

Tlieorem 11 if C is an MDS code with length n and minimum 
distance d, then 



p{C) < r{n,d~2). 



(27) 



We conjecture that equality holds always. 

Conjecture 12 If C is an MDS code with length n and 
minimum distance d, then 



p{C) = Tin,d-2). 



(28) 



Up to now we have bounded p{C) between two well-defined 
combinatorial quantities, T{n, d— l,d — 2) and r(n, d — 2). 
Clearly, any lower bound on T(n, d— 1, 2) is alower bound 
on p{C) and any upper bound on T{n, d—2) is an upper bound 
on p{C). We will actually proceed in this way - in fact we 
will be focusing solely on the upper bound, and all results we 
shall show for p{C) hold for T{n,d — 2) as well, although it 
may not be made explicit. 

We start by looking at how things work for d = 3,4,5, 
where much stronger results can be derived. 

The case where d = 3 is quite trivial, and the result is 
actually implied by the best upper and lower bounds on p{C) 
given in [1]. 

Tlieorem 13 Let C be an MDS code with length n and 
minimum distance d = 3. Then 



p{C) =r(n,2,l) 



(29) 



Proof It suffices to show that n - 1 < T{n, 2, 1) < 
r("^: 1) < '1 — 1- On one hand, it is easy to verify that any 
{n — l)-subset of [n]^ is a single-exclusion {n, l)-system. On 
the other hand, a Turan {n, 2, l)-system cannot have (n — 2) or 
fewer blocks, or there would exist i,j e [n], such that {i,j} 
does not contain any of the blocks. ■ 
The case for d — 4 needs a bit more work. 



Lemma 14 For all n> 3, 



r(n,3,2) < 



(30) 



Proof: The proof is by construction. Let L = {1, 2, 3}, 
i? = [n] \ L, and T = [L]^ u [i?]^. It is easy to verify that T 
is a Turan {n, 3, 2)-system, and it has ("2 + 3 blocks. ■ 



Tlieorem 15 Let C be a MDS code with length n > 6 and 
minimum distance d = A. Then 



n /[Til \ 
p(C)=T(n,3,2)= [-J (2-1) 



(31) 



Proof: The formula for T{n, 3, 2) is a known result first 
discovered by Mantel [10] in 1907. Later, Turan [11] [12] 
solved the more general case of T{n, k, 2). 

It suffices to show that r(n, 2) < r(n,3,2). Let T be a 
Turan (n, 3, 2)-system with smallest size. We show that T 
must also be a single-exclusion (n, 2)-system. By definition 
of T, all 3-sets are covered. We show that all 1- and 2-sets 
are covered as well. 

Suppose there is a 1-set, say {i}, that is not covered. Then 
i is contained in all blocks of T. But this implies that all 3- 
subsets of [n] \ {i} are not covered, contradicting the fact that 
T is a Turan (n, 3, 2)-system. 
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Suppose there is a 2-set, say that is not covered. This 

impUes that a block of T either is {«, j}, or is disjoint from 
Note that {i,j} must be a block of T, or 3-sets like 
{i,j,k} would not be covered. Also, all 2-sets disjoint from 
{i,j} must be blocks of T; otherwise, if {k, 1} C [n] \ 
is not a block, then 3-set {i, k, 1} would not be covered by T. 



This shows that T{n, 3, 2) = |r| = 



-1. But (' 



1 > 



> 6, which contradicts Lemma [141 



(V)+3for 

Remark Since the formula for T{n, 3, 2) is known, Lemma[T4l 
may seem unnecessary. But we find its simple construction to 
be appealing, and the bound it gives, though loose, is enough 
to show r(n, 2) = T{n, 3, 2) without further knowledge about 

T(n,3,2). □ 

Remark The proof of Theorem^jneeds n > 6 to go through. 
It turns out that the only two cases for n < 6 are indeed 
"anomalies" for which p{C) is strictly greater than T{n, 3, 2). 

For n = 4, r(4. 3, 2) — 2, while it is simple to see that 
p{C) = 3. For n = 5, r(5, 3, 2) = 4. But it can be shown that 
p(C) = 5. □ 

For d = 5, we first note a couple of bounds on T{n, 4, 3). 

Lemma 16 



T(n,4,3)< 



1 



1 



(32) 



where equality holds for n < 13. 



Proof: The upper bound comes from a construction of 
Turan (rt, 4, 3)-systems due to Ringel [13], which has been 
verified to be optimal for n < 13 ([9]). ■ 



Lemma 17 For n > 13, 



T(n,4,3) > — 
^ ' ' - 143 



Proof: It is known ([14]) that T{n,k,r)/{'; 
decreasing in n, hence 



(33) 



IS non- 



T(n, k, r) > 



Tjno, k,r) 
(?) 



for n > riQ. 



(34) 



Since T(13,4,3) = 112 by Lemma [T6l the resuh follows. 



In the following, assume n > 6. Let T be a Turan {n, 4, 3)- 
system of smallest size. If T is a single-exclusion {n, 3)- 
system then we are done. Otherwise, let t be a smallest i- 
set that is not covered. Then |t| = 1, 2, or 3. (All 4-sets are 
covered since T is a Turan (n, 4, 3)-system.) 

First, suppose |t| = 1. Since l is not covered, it is contained 
in all blocks of T. Then a 4-subset of [n] \ l is not covered. 
This is a contradiction. 

Next, suppose \l\ = 2, say l — Then any block of 

T either contains t or is disjoint from t. Out of the {n — 2) 
3-sets that contain t, at least (n — 3) must be in T. Otherwise 
we could find a,b ^ ["-] \ such that {i,j,a},{i,j,b} ^ T. 
But then the 4-set {i,j,a,b} would not be covered. On the 
other hand, all of the ("3^) 3-sets that are disjoint from l 
must be blocks of T. Otherwise, if {a, b, c} C [n] \ l is not 
a block, then {i,a,b,c} would not be covered. In summary, 
T must have at least ("~^) + 7i - 3 blocks. Since ("^ ^) + 
" " 3 > ||J [iigJ-J (2 [Sg^J + 1) for 71 > 6, this contradicts 
Lemma ^) 

Lastly, suppose \l\ — 3, say l = {i,j,k}. Then for all 
f3 £ T, \f3 n i\ ^ 2. Note the following facts: 

Fact 1: L itself must be a block of T, otherwise 4-sets like 

{i,j, k, a} would not be covered. 
Fact 2: For each 2-set {a, b} C [n] \ i, at least two of {a, b, i}, 
{a,b,j}, and {a,b,k} must be blocks of T. This is 
true because if, say, {a, b, i} and {a, b, j} both were not 
blocks of T, then {a,b,i,j} would not be covered. 
Fact 3: All blocks that are disjoint from t form a Turan (n — 
3, 4, 3)-system. 

Together, these imply that T(n,4,3) = |r| > 1 + 2("2^) + 
T{n — 3,4,3), which contradicts Lemma [T6l and Lemma [TTl 
for n = 6, . . . , 53. 

For n > 54, we do not have an immediate contradication. 
However, note that a 3-set that contains zero or one element of 
L is covered due to Fact 2, and one that contains two elements 
of L is covered due to Fact 1 . So, in this case t must be the only 
3-set that is not covered. Since t is also the smallest uncovered 
7-set, by adding one more block to T to cover t, we have found 
a single-exclusion (n, 3)-system that has T{n, 4, 3) + 1 blocks. 

■ 

Corollary 19 Let C be an MDS code with length n and 
minimum distance d = 5. Then 



Theorem 18 Let C be an MDS code with length n and 
minimum distance d — 5. Then 



P{C) 



1 



1 



for 71 = 6, . . . , 13. 

(37) 



Further, 



T(7i,4,3)<p(C)<r(ri,4,3) + l. 



p{C) — T{n, 4, 3), for n = 6, . . . , 53. 



(35) 



(36) 



1, 



We have seen that r(7j, d—2) (and hence p{C) of an MDS 
code with the corresponding parameters) is almost the same 
as T{n, d — 1, d — 2) for small values of d. We now show that 
these results can be generalized in an asymptotic sense when 
d is fixed. 



Proof: It suffices to show that r{n, 3) < T{n, 4, 3) 
and T{n, 3) = T{n, 4, 3) for n = 6, ... , 53. 

For n = 5, it is known that T(5,4,3) = 3, while it can 
be easily verified that r(5,3) = 4. So the claimed inequality 
holds for n — 5. 



Theorem 20 For fixed d, as n 00, 

r(7i,d- 2) = T{n,d - l,d-2){l + Oin-^)). 



(38) 



HAN AND SIEGEL: IMPROVED UPPER BOUNDS ON STOPPING REDUNDANCY 



7 



Proof: We show that we can always add 0{n'^~^) blocks 
to a Turan (n, d— 1, d— 2)-system to make it a single-exclusion 
(n, d — 2)-system. 
Let L = {1, . . . , - 2}, and R ^ [n]\ L. Let T' 



ld-2 



: /? n L 7^ 0}. Clearly, 



d-3 



m=0 



d-2 
d — 2 — m 



n — d- 
m 



Oin"--"). (39) 



We show that blocks of T' cover all i-sets, i ~ 1,2, . . . ,d—2. 
Let t be an z-set and a e t be an arbitary element. Take i\{a}, 
adjoin to it the {d — i — 1) smallest elements of [n] \ l and 
call the resulting set /3. It is easy to verify that f3 £ T' and 

k\/3| = i. 

Now, let T be a Turan {n,d— l,d— 2)-system of smallest 
size. Let S = TUT'. Then S* is a single-exclusion {n,d—2)- 
system with T{n, d - 1, d - 2) + 0{n'^~^) blocks. 

Finally, note that T{n, d-l,d-2) = e(n'*"2), since 



1 



n 
d-2 



< T(n,d- l,d-2) < 



n 
d-2 



(40) 



and the result follows. ■ 
With Theorem |20l the following result is immediate. 

Theorem 21 Let {Ci}°^i be a sequence of MDS codes with 
strictly increasing code length {ni}'^^. If d{Ci) = d for all i, 
then as i ^ CO, 



p{Ci) = T{n,d-l,d-2){l + 0{n-^)), 
where n — nj. 



(41) 



Katona, Nemetz and Simonovits [14] showed that 
T{n,k,r) / is non-decreasing in n and hence there exists 
the limit 

T{n, k, r) 



t{k, r) = lim 



(") 



(42) 



Theorem 1201 and Theorem 12 1 1 essentiallv tell us that for fixed 

d, T{n, d—1, d— 2), p{Ci), and T{n, d — 2) are all asymptotic 

tOt(d-l,d-2)(,!!2).2 

Corollary 22 Let {Ci\°^i be a sequence of MDS codes with 
strictly increasing code length {ni\°^^. If d{Ci) — d for all i, 
then 



lim 

i — »oo 



lim 

n — *oo 



r(n,fi- 2) 
(d-2) 



tid-l,d-2). (43) 



The value of t{r + l,r), although unknown for r > 2, is 
well-studied. In fact, the determination of t{k, r) for k > r > 
2 has been one of the most challenging open problems in 
combinatorial theory (for the solution of which Erdos offered 
a $1000 award; see [15]). Some of the known bounds on t{r + 
l,r) are summarized in Table|Il(cf. [11], [12], [8], [16], [17], 
[18], [19], [20]). 

^Functions f{x) and g{x) are said to be asymptotic to each other as x — > 
xo if liriia^^ajQ = 1, and is denoted by f(x) ~ g{x). In tliis paper 

we usually talk about integer functions of n and the condition n — > 00 is 
sometimes omitted where there is no confusion. 



TABLE I 

Some known bounds on t{r + 1, r) 



T 


Lower Bound 


Upper Bound 


2 


1 


1 




2 


2 


3 


9-vT7 
12 


4 
9 


4 


37 


5 




143 


16 


5 


37-v'345 


5 




SO 


16 


6 


1 


17 




6 


64 


asymp. 


1 
r 





In contrast, the bounds on p{C) for MDS codes given in [1] 



are 



1 ^ p{C) ^ max{d-L,d- 1} 



d-l 



id-2) 



< 



(44) 



Compared to what's promised by Corollary |22l and Table U 
here the lower bound is already close to our best knowledge 
of t{r + l,r). On the other hand, since d^ + d — 1 = 
n + 1, max{d-'-,d — l}/n > 1/2. This suggests room for 
improvement in the upper bound. 

We will derive new upper bounds on the stopping redun- 
dancy of MDS codes through constructions of single-exclusion 
systems. First, consider the following construction of a Turan 
{n, r + 1, r)-system due to Kim and Roush [21]. 

Construction 1 Partition [n] into / disjoint sets, 
Nq, . . . , Ni^i, with sizes as equal as possible. (For example, 
let Ni :— {k E [n] : k = i mod I}.) For any X C [n], define 



w{X) := ^i|Xn7V^| 



(45) 



i=0 



For j 0,1, 1, let 

:= {B e [nY ■.3k,BnNk= 0} 

U {B e [nY : w{B) = j mod 1} . 



(46) 



Theorem 23 ([21]) For all I and all j, Bj as defined in 
Construction^is a Turan {n,r + l,r)-system. □ 

Proof Let C E [nY^^ be any (r+l)-set. If there exists k 
such that Cn A^fe = 0, then any B £ [CY satisfies BnNk =9 
and hence is a member of Bj. Otherwise, we can find e 
CnNk for all k. Let Bk := C\ {cfe}. Then Bk S [CY- Note 
that w{Bf;) — w{C) — fc, k — Q, . . . ,1 — 1. So by choosing k 
we can realize any value of {w{Bk) mod I). Therefore, for 
any j, there exists k such that Bk ^ Bj. ■ 

Theorem 24 For all j, Bj as defined in Construction is a 
single-exclusion {n,r)-system if I > n/{n ~ r — 1). □ 

Proof: Given Theorem |23] it suffices to show that for 
any C G [n]*, i — 1, . . . ,r, there exists B E Bj such that 

\C\B\ = 1. 

If there exists k such that C N^, = 0, pick D E 
[[n] \ NkY^^ such that CCD. The availability of such a 
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choice is guaranteed if n — \n/l~\ > r + 1, which is implied 
by I > n/{n — r — l). Let B = D \ {c} where c is an 
arbitrary element of C. Then B E Bj since B n Nk — 0. 
Also, \C\B\^ \{c}\ = 1. 

On the other hand, if for all k, C D Nk ^ 0, we can find 
CkeCnNk for all k. Pick D e [n]^+i such that CCD. Let 
Bk := D\{ck}. Similar to the proof of Theorem 1231 we can 
show that for any j, there exists k such that Bk G Bj. Also, 
by construction, \C \ Bk\ = |{cfc}| = 1. ■ 

Now, we wish to estimate the smallest number of blocks in 



Bj. Note 



min IB, 



o<j<i-i 

< min (\{B e\nY ■.3k,BnNk = 0}\ 
o<j<i-i 



{B e [nY : w{B) = j mod /} | 



[j {B e [nY : B n Nk ^ $} 



k=0 



min I {B E [nY ■ w{B) = j mod 1} \ 



<Y.\{BE[nY:BnNk^n\ + U'', 



< I 



fc=0 

n 



(47) 

(48) 
(49) 



LfJ 



1 fn 

r 



Therefore, we arrive at the following upper bound on T{n, r). 



better than 9 (^(^"2)], given by (|44|l. Note that from 

m, P(C) is at least e(i(/2)). 
3) k ^ n — d + I, the dimension of C, is fixed: 

Theorem 1261 requires that / > n/fc. If fc > 4, we can 
choose / such that I E — 1, Then the bound of 
Theorem becomes, asymptotically, 

p(c)</"-LfJ 



< I 



d-2 
n — 3 

i-k-1 



1/ n 
l\d-2 
1 / n 

'^l\n-k-l 



n \ \n 



n 
k + 1 



' n 
1 Vfc 



(53) 
(54) 
(55) 
(56) 



The bound above is asymptotic to -^r[{^)- For com- 
parison, i44\ implies an upper bound that is asymptotic 
to (j,"]^), and a lower bound of ■j;qrr(fe)- 
The last case of the discussion above is interesting in its 
own right and we summarize it in the following theorems. 
Note that what we have talked about applies to T{n, d~2) = 
r{n, n — k ~ 1) as well as p(C). 



(50) Theorem 27 For fixed k, as n 00, 



1 r(n,n-fc-l) 3 



1 



(57) 



Theorem 25 For all integers I > n/{n — r — 1), 



r(n,r) < I 



This immediately leads to an upper bound on p{C). 



(51) 



Theorem 26 Let C be an MDS code with length n and 
minimum distance d. For all integers I > R^^, where R ~ 
{n — d -\- l)/n is the code rate of C, 



p{C) < I 



d-2 J l\d-2 



(52) 

□ 



Let's interpret this upper bound asymptotically as n ^ 00. 
Consider the following cases. 

1 ) d is fixed: 

By choosing I = Y{d— 2)/{2\n{d— 2))J, one can see 
that the upper bound of Theorem |26l is better than 
^'^^rf'-2~^' (d-2)' which is tighter than that of (gU for 
most values of d. Note that for this particular case 
we akeady knew more — Corollary |22] gives a better 
understanding of the asymptotic behavior of p(C), and a 
tighter bound on t{d—l, d—2) could have been used. The 
upper bound in Theorem|26lis valuable in that it is exact 
— it holds for all n, rather than only asymptotically in 
n. 

2) 5 < \ is fixed: 

Choosing / = [(d - 2)/(21n(d- 2))J, we see that the 
upper bound of TheoremEiis O (^"2)) ' which is 



Proof: The lower bound is trivial since r(n, n — k,n — 
k — I) > kTii^k)- '^Iso, we have seen that the claimed upper 
bound is true for fc > 4. 

For fc = 3, note that if we had been a bit more careful in 
writing i5Q\ . we could have shown that 

-LfJ' 



r(n,r) < (/ — {n mod I)) 



+ (n mod I) 



LfJ-1 



1 /n 
l\r 



(58) 



Choosing / such that I E ^ + 1) and noting I — {n 
mod ^) < 3 if 3 I n gives the desired result. 

For fc = 2, we show that we can construct a single-exclusion 
(n, n — 3)-system using less than ^{^) blocks. Let n = 3t + r, 
r = 0, 1, 2. Consider the n-set N := {[t] x {0, 1, 2}) U {{t + 
1} X {0,...,r — 1}). Choose as blocks the complements of 
the following triples (if they exist in N) to construct S: 

1) {{x,0),{x,l),{x,2)}, forx= l,...,t; 

2) {(x, i), {y, i), (y, i + 1)} and {{x, i), {x, i + 1), (y, i)}, 
for x,y E[t + 1], x < y, i ^ 0, 1, 2; 

3) {(x, 0), {x, 2), (t + 1, 0)}, for X = 1, . . . , i, if r > 0. 
(In the above, i -I- 1 is modulo 3.) We claim that 5 is a single- 
exclusion (n, n — 3)-system. Let l be an z-set. We show that l 
is covered in that there exists f3 E S such that \l\/3\ — 1, i.e. 
such that II" n P^l = 2. Let's call the set of points in N that 
share a common first coordinate a bin. It is not hard to verify 
that if l'^ intersects some bin at exactly two points, then l is 
covered. Also, if l'^ intersects some two bins each at just one 
point, then l is also covered. Now, excluding the two cases 
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already discussed above, we may assume that i'^ intersects no 
bins at two points, and intersects at most one bin at one point. 
But since ji"^! > 2, l"^ must intersect some bin at three points. 
This fact, however, also implies that l is covered. Finally, it is 
simple algebra to verify that l^l < Kj)- 

For A: 1, it is not hard to see that T{n, n — 2) ~ n — 1. 
(Note in this case T{n, n - 1, ?i - 2) = [n/2] .) ■ 

The following is an immediate consequence of Theoreml27l 

Theorem 28 Let {Ci}°^i be a sequence of MDS codes with 
strictly increasing code length {ni}°^j^. If the dimension of Ci 
is k for all i, then as i — > oo. 



k + 1 
where n ^ Ui. 



1 < < 



(;:) 



k + l 



0\ 



(59) 



Previously we have seen a close connection between 
r(n, d — 2) and T(n^ d— 1, d — 2). Let's see what the results 
of Theorem 1271 and Theorem 1281 tell us in those terms. 

Theorem 29 For fixed k, as n oo, 

T{n,n-k-l) < T{7j,n-k,n-k-l){3 + 0{n-'^)). (60) 

□ 

Proof: It suffices to note that T{n, n — k,n — k — 1) > 
■j^Tii^)^ ^nd the result follows directly from Theorem 1271 It 
should be noted that for fixed a and b, T{v, v — b,v — a) is 
asymptotic to (cf. [22] [23]). Therefore, if k is fixed, 

then T{n, n — fc,rt — fc — 1)^ (^') and the claimed result 
is indeed the best that one can get out of Theorem]^ ■ 

Theorem 30 Let {Ci}°Zi sequence of MDS codes with 
strictly increasing code length {ui}'^^. If the dimension ofCi 
is k for all i, then as i — > cx3. 



p{C,) < T{n, d-l,d-2){S + O(n-i)), 



(61) 



where n — rii, d = d{Ci) = — fc + 1. □ 

Remark The proof of Theorem |^ shows that for k = 1,2, 

r(n,n-fc-l) < T{n,n~k,n~k-l){2 + 0{n-^)). (62) 

Empirical data suggest that this may be true for all k, so that it 
may be possible for the constant factor of 3 to be improved. □ 

Next, consider the following construction of a Turan {n, r + 
l,r)-system, due to Frankl and Rodl [24]. 

Construction 2 Partition [n] into / disjoint sets, 
No,...,Ni-i, with sizes as equal as possible. For all 
X C [n], define S{X) := {i : X n iV,; ^ 0} and 
s{X) := |5'(X)|. So s{X) is the number of partitions that X 
intersects. Also, define 



'j{X) := ^i|XniV,;| 



(63) 



Now, for j e {0, ... ,1 - I}, let 

Bj := {B G [nY : {w{B) + j) mod I 
e{0,l,...,l~siB)}}. 



(64) 



Theorem 31 ([24]) For all I and all j, Bj constructed ac- 
cording to Construction^ is a Turan {n,r + l,r)-system. □ 

Proof: Note that in general, if x ^ X O Ni, then w(X \ 
{x}) = w{X) — i. Let X he a {r + l)-set. Since X intersects 
s{X) partitions, {{w{Y) + j) mod I : Y E [XY} contains 
s{X) distinct values. Hence, there exists Y E [XY, such that 
iw(Y) + j) mod I e {0, 1, . . . , / - s{X)}. Now, note that 
s{Y) < s{X) since Y C X. Therefore, {w{Y) + j) mod / G 
{0, 1, . . . , / - s{Y)}, which impHes that Y e Bj. ■ 

Theorem 32 If n > l{r + 1), then for all j, Bj constructed 
according to Construction |2] is a single-exclusion {n,r)- 
system. □ 

Proof Given Theorem |21 it suffices to show that all 
i-sets are covered by Bj, i = 1, . . . ,r. 

Let X be an i-set. Choose Z e [7i](''+^\ such that X C 
Z and S{Z) = S{X). This is possible as \ [jkeS{X)^k\ > 
s{X){r +1) > r + 1. Consider the class of r-sets, y := 
{Z \ {x} : X e X}. Note that {{w{Y) + j) mod l:Y ey} 
contains s(X) distinct values. Hence, there exists Y £ y, such 
that {w{Y) + j) mod / e {0, 1, . . . , ^ - s{X)}. Now, note 
that Y C Z implies that s{Y) < s{Z) = .s{X). Therefore, 
{w{Y)+j) mod ; e {0, 1, . . . , ; - s{Y)}, which implies that 
Y e Bj. Finally, it is clear that \X\Y\ = 1. ■ 

Now we wish to estimate mirij \Bj\. It can be shown that 
([8]) 

LfJ' 



/-I 



(65) 



Therefore, 



mm 

j 



Thus, we have the following theorems. 
Theorem 33 For all integers I < n/{r + 1), 



(67) 



Theorem 34 Let C be an MDS code with length n and 
minimum distance d. Then for all integers I < (1 — i?)^^, 
where R = {n — d + l)/n is the code rate of C, 



P{C)< 



1 

l\d-2 



d-2 



(68) 



The requirement that / be no greater than (1 — turns 
out to be too restrictive for most cases and makes the upper 
bound less useful when R is not close to 1. To mitigate the 
problem, we can get rid of this requirement by adding some 
more blocks to Bj. For the sake of discussion, let's first assume 
I I n. 

Construction 3 Arrange elements of [n] into a j x I matrix 
(in an arbitrary way). The columns of this matrix partition 
[n] into I disjoint sets with equal size which we denote by 
Nq, . . ., Ni^i. With iVo, • • ■ , Ni^i, let Bj be defined the same 
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way as described in Construction |2 Now, the rows of this 
matrix also partition [n]. We denote them by Mq, . . . , Mil-i. 
For all X C [n], define 



v'{X) := i\Xf^M, 



(69) 



For i = 0, . . . , f - 1, let 

Mt-.^^B (^[nY ■.w'{B) = t mody}. (70) 
Finally, for all j, t, let 

Bj.t -.^ BjUMt. (71) 

□ 

We show that Bj^t as defined in Construction |3] is a single- 
exclusion (n, r)-system for all I. 

Lemma 35 Let l> 2 be an integer. Let L = {0, 1, . . . , ^ — 1}. 

For all X C_ L, define 



iex 



Then, for all k, k = 1, . . . ,1 — 1, 

{\\k\\ mod I : kE [Lf} = L. 



(72) 



(73) 



Proof: First, it is easy to see that the claim is true for 
k = 1 and 2. The case fc = 1 is quite trivial. For = 2, it 
suffices to note that i ~ ||{0, for i ~ 1, ... ,Z — 1, and 

o = ||{i,;-i}||. 

In general, if the claim is true for k — m, then it is also 
true for k = I ~ m, since 

{||k|| mod / : k e [L]'-"} 
= {||L|| - ||k|| mod ? : k e [L]"}. (74) 

So, the claim is also true for k — I ~ 1 and k = I — 2. 

Now, for the general case, let's assume k < I — 3. The idea 
is to consider pairs of elements in L that sum to modulo 
I. First, suppose I is even. Then L can be partitioned in the 
following way: 

l/2-l 1/2-1 

L = {0}U{l/2}U U {^,/-^} = {0}U{^/2}U |J Z,, (75) 



For odd I, the proof is very similar and we will not elaborate 
here. ■ 

Theorem 36 For all I, j, and t, Bj^t as defined in Construc- 
tion]3\is a single-exclusion {n,r)-system. □ 

Proof: Let X be an i-set, i — 1, . . . , r, and a; e X be 
an arbitrary element. First, suppose that for all k, Nk ^ X. If 
r < n — l, then we can find an r-set Z D X such that Nk ^ Z 
for all k. Now, choose yk G Nk \ Z for all k and consider 
r-sets of the form Yk := (Z \ {x}) U {yk}- For all j, we can 
choose k such that w{Yk)+j = mod /, and hence Yk G Bj. 
Clearly, \X \Yk\ = 1. On the other hand, if r > n - /, then 
we can find an {n — /)-set Z ^ X such that Nk ^ Z for all 
k. Clearly, [n] \ Z intersects each Nk at exactly one element. 
Consider r-sets that consist of the union of Z \ {x} and an 
{r--n + l + l)-subset of [n] \ Z. By Lemma l35l for all j, there 
exists W e [[n] \ ^J'-^+'+i such that if F = (Z \ {x}) U W 
then w{Y) + j = mod I. Therefore, Y e Bj and clearly 
\X\Y\ = 1. 

Otherwise, suppose Nk Q X.By construction, Nk contains 
elements from each Mm- Let Z D X he an {r + l)-set; then, 
by choosing Y E y :^ {Z \ {x} : x E X}, we can realize 
any value of w'{Y). Hence, for any t, there exists an 7--set 
Y E Mt such that \X\Y\ = 1. ■ 
If I ] n, we can define A/q, . . . , Af^^j _i by applying 



° Construction |3] to the first [n//J/ elements of [n] and letting 



M 



LtJ-1 



include the extra (n mod I) elements. All reasoning 



is still valid. 
Clearly, 



Hence, 



LfJ-i 

t=0 



min|A^t| < - — — 

t [n/l] 

By the union bound, \Bj,t\ < \Bj \ ^ 
at the following bounds. 



(76) 
(77) 

\Mt\, hence we arrive 



Theorem 37 For all integers I, 
1 (n, r) < 



(78) 



where Zi := {z, Z — i}, j = 1, . . . , Z/2 — 1. We show that for 
all 2 E L, we can find a fc-set (3 such that ||/3|| = j mod /. If 
k is even, then: 

• If J G Zjn for some m, let /3 be the union of {0, j} and 
(fc/2 - 1) Zj's other than Z,„. 

. If J = 1/2, let P be the union of {0, j} and (fc/2 - 1) 
Z^'s. 

. If j = 0, let /3 be the union of fc/2 Zi'&. 
Similarly, if fc is odd, then: 

• If J G Z„i for some m, let f3 be the union of {j} and 
(fc - l)/2 Zi's other than Zm- 

. If j = 1/2, let (3 be the union of {j} and (fc - l)/2 Zi's. 
. If j = 0, let l3 be the union of {0} and (fc - l)/2 Z,'s. 



Theorem 38 Let C be an MDS code with length n and 
minimum distance d. Then for all integers I, 

,^,^{ r}-i'^) + \L-2) ifl<{l-R)-' 

^„_Ln/^j^+ i + _i_)(^«j '/^>(l-i?)-^ ' 

(79) 

where R = [n — d + l)/n is the code rate of C. □ 

Note that when we choose I in the region I > {1 ~ R)^^ , the 
upper bound is never better than -^(^"2)- strength of 

the bound above still lies in the regime of high rate codes. 

Figures ^ through |3] compare the upper bounds we have 
obtained so far, i.e. those of Theorem 1261 and Theorem 1381 to 
the previously known bounds of ( I44> . In the plots, all bounds 
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Fig. 1. Bounds on p{C) for (n, k, d) MDS codes, d = 50 is fixed. Bounds 
are normalized relative to (^"2)- 
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Schwartz & Vardy 
Construction 1 
Construction 3 



- - Lower Bound 




100 200 300 400 500 600 700 800 900 1000 



n 

Fig. 3. Bounds on p(C) for (n, k, d) MDS codes, fc = 50 is fixed. Bounds 
are normalized relative to (^"2)- 



- Schwartz & Vardy 

- Construction 1 

- Construction 3 

- Lower Bound 




100 200 300 400 500 600 700 800 900 1000 



Fig. 2. Bounds on p{C) for (n, k, d) MDS codes. R = 0.5 is fixed. Bounds 
are normalized relative to (,"„). 



are normalized with respect to (^j",)- We see that both newly 
proposed upper bounds are tighter than J44t in a variety of 
situations, with the one based on Construction^outperforming 
the one based on Construction|3]for all but very high code rate 
scenarios. 



IV. Conclusion 

We have obtained new upper bounds on the stopping re- 
dundancy of linear codes. Compared to the previously known 
bounds of [1], [2], our bound based on the "probabilistic 
method" gives better results for a number of interesting cases, 
including for all "good" codes, i.e. those whose minimum 
distance is asymptotically non-trivial relative to code length. 

Though tighter, the new upper bounds for the case of "good" 
codes are still exponential in the length of the code. It remains 



an open question whether there exist "good" codes whose 
stopping redundancy is polynomial in the code length. 

Improving the lower bound on stopping redundancy seems 
to be difficult. Applying the probabilistic method only yields 
the same bound as given in [1]. 

For MDS codes, the interesting relationship between stop- 
ping redundancy and Turan numbers has been explored. 
We have defined a new combinatorial quantity, the single- 
exclusion number r{v,r), and related it to the Turan number 
and the stopping redundancy of MDS codes. By studying 
T{v,r), we have obtained new upper bounds on the stopping 
redundancy of MDS codes, which have been shown to be 
tighter than the best previously known bounds for various 
situations. We have also proved that for MDS codes with 
length n and minimum distance d, p{C) is asymptotic to 
T{n, d — 1, d — 2) for fixed d, and is asymptotic to T{n, d — 
1,0? — 2) up to a constant factor of at most 3 for fixed 
k — n — d + \. We conjecture that in the latter case the 
constant factor can be improved to 2. We also conjecture that 
p{C) = r(n, d — 2) for all MDS codes. For one thing, the two 
are asymptotic to each other if d is fixed. Further, for d = 3, 4, 
both p{C) and r(n, d - 2) are equal to T(n, d - 1, d - 2). 
For d = 5, we have shown that neither can differ from 
T(n, d — 1, d — 2) by more than 1. 

Appendix I 
The Binary Golay Code 

We present here a parity-check matrix with 34 rows that 
achieves maximum stopping distance and corrects more low- 
weight erasure patterns than the parity-check matrix given in 
[2]. The details of our parity-check matrix, denoted by H, are 
given in Table |ll| It was found by a greedy computer search. 
The idea is to start with a random selection of codewords from 
^24 (note that Q2i is self-dual), and in each iteration, replace 
one codeword in the selection so that as many more i-sets 
as possible are covered. When no such improvements can be 
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TABLE II 

Parity check matrix with 34 rows for ^24 that achieves 
stopping distance 8 



/OOOOOOOl 101 10100001 1 1 \ 

0000 0100100011110100001 

0000001 1 1010000101001010 
10 010010010010100001 10 
000001001 1 101 10000100001 
000001 1000001 1 10001001 10 
000001 1 1001001 1000001001 
10001000000000101 101 1 10 
1000100101 1 1 100000100000 
000010100000001001101011 
10001 1 100000001 100000101 
00010001001 1 100001010010 
100100100001000011001010 
0001010100010101010010 
10011001110000100000010 
00100000100001010101 1 10 
0010001110111000000000 1 
001001 1001001010010000 1 
00101 10000010101000001 10 
001100001010110010010000 
001 1 10000010100001 100001 
010000001 10100100001 1 100 
1 1000010010000010100001 1 
010001000110001100010001 
010010010001010110100000 
01001100000100001001010 1 
11010011010000001010000 
0101010100001001 1001000 
0101100100001010001000 10 
1 1 10000000010000010101 1 
111000101010000010000010 
1 1 10100000001000101 100 
1 1 1 100001 1000001000100 

Voiiiioooooooiioiooooiooo/ 



made, an additional codeword is added to the selection and the 
iteration continues. The process is stopped when the desired 
stopping distance is achieved. We find that it is enough to only 
consider covering 7-sets, and verify in the end that the matrix 
obtained indeed covers all smaller i-sets and has the proper 
rank. 

Table |lll] compares the number of undecodable erasure 
patterns by weight w (number of erased bits) for iterative 
decoders based on H, iJ24 (the 34-row parity-check matrix 
reported in [2]), and the maximum-likelihood decoder We see 
that the iterative decoder based on H corrects considerably 
more lower weight erasure patterns than does the one based 
on i?24' which implies that it will perform better when the 
erasure probability is small. For a binary erasure channel with 
erasure probability p, a detailed comparsion shows that for all 
p < 0.349, the iterative decoder based on H has a smaller 
probability of decoding failure. 



Appendix II 

Derivations in the Asymptotic Comparison of 
Bounds 

A. Binary Linear Codes (Example^ Case 1) 

Noting that — log(l — x)^ as a; — > 0, we see the upper 
bound in (CB is 0(2''"), hence so is the bound in Theorem |3] 



TABLE III 

Number of undecodable erasure patterns by weight w for 
different iterative decoders for (724 



w 




-"24 ^ ' 




< 7 











8 


3284 


3598 


759 


9 


78218 


82138 


12144 


10 


580166 


585157 


91080 


11 


1734967 


1717082 


425040 


12 

> 13 


2569618 

(24) 


2556402 

(24) 


1313116 

(24) 



On the other hand, note that 

f (:)(-^)'^U-0(-fte^)- 

(80) 

Setting 

and solving for p, one can readily show that p* (n, d{C)) is also 
17(2''"). Therefore, the bound given by Theorem |3l is indeed 

8(2''"). 

In comparison, consider the bound in Theorem ^ For < 
<5 < ^, the asymptotic Plotkin bound implies that ^ < 
Noting that h{p) > 2p for p < ^, we have 




The analysis for the bound of Theorem|2]is similar, and one 
can show that the same asymptotic result applies. 

B. Linear Codes over ¥q (Example^ 

Showing that the bound in Theorem is <d{q^") is very 
similar to the binary case, and we will not elaborate here. 

Now, consider the bound of Theorem |6l Let 9 = ^y^-. For 
< 5 < 9, we see that < | < by the asymptotic Plotkin 
bound. Noting that for all < 6* < 1, h{p) > ^p for 
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< p < ^, we have 
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